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RELATED APPLICATIONS 
[0001] This application relates to and claims priori- 
ties from corresponding Japanese Patent Application Nos. 
2000-344534 filed on November 10, 2000 and 2001-341562 
filed on November 7, 2001. 

BACKGROUND OF THE INVENTION 
[0002] Field of the Invention 

The present invention relates to an apparatus for 
utilizing multimedia information and, more particularly, 
to a method and an apparatus for searching the movie im- 
ages wherein the utilization, storage and editing of the 
multimedia information as well as the fee payment for the 
utilization of the multimedia information can effectively 
be performed. 

[0003] Description of the Related Art 

Conventionally, the so-called content information 
including the still image, audio data, text data and the 
movie image is kept as it is, if it has been once recorded 
and there is no access thereon by the user. Therefore, 
with the increase in the content information under utili- 
zation, it would be necessary for the storage device to 
have a storage capacity to cope with the increased amount 



of information. 

[0004] Since the content information produced has dif- 
ferent importance for each producer and each user and fur- 
ther its importance usually changes with the lapse of 
time, in the conventional technique, it is impossible to 
store and utilize the information in accordance with its 
necessity, thereby preventing the limited hardware re- 
sources of the user side from being effectively used. For 
example, in the case where the content information was 
frequently used in the past but there is no utilization at 
all at the present, it is normal that such content infor- 
mation is now stored as it had been used in the past. In 
the conventional technique as above, it cannot be said 
that the storage device is effectively used if the value 
of the information is taken into consideration. Here, the 
content information refers to the digital multimedia in- 
formation such as the text data, audio data, still image, 
movie image and map. 

[0005] Further, in buying and selling the content in- 
formation through and on the network in the conventional 
technique, it is possible to provide the user with the 
content information upon receipt of the fee payment only 
when the user purchases the information first but thereaf- 
ter it is impossible to receive any fee every time the 
user utilizes the same content information. 



[0006] Therefore, the principal object of the invention 
is to achieve the realization of the utility environment 
wherein only the necessary parts of the information can be 
utilized according to the user's requirements and wherein 
the variable features of the values of the information are 
used by unitarily treating the operation process informa- 
tion and the internal structural information with the con- 
tent information which is produced into the layered struc- 
ture and which is capable of being resolved into parts. 
The operation process information and the internal struc- 
tural information are ones with the utilization environ- 
ment about the content information such as the lapse of 
time, network environment,, the processing ability of the 
terminal and the value of the same content information 
which changes from time to time being taken into consid- 
eration. 

SUMMARY OF THE INVENTION 
[0007] According to the invention, the amount of the 
content information whose utilization value has become low 
is automatically reduced and, thereafter, in accordance 
with the necessity, the part of information which has been 
once reduced can be obtained again through the on-line 
network, whereby the relevant information can be restored. 
As a consequence, it is possible to effectively utilize 



the physically limited hardware resources at the user 
side. 

[0008] The content information whose value becomes low 
can be automatically reduced or deleted, and such content 
information whose partial data has been once deleted can 
be restored, if desired, by newly obtaining the partial 
data which corresponds to the deleted partial data from 
the network. As a consequence, it has become possible to 
effectively utilize the limited hardware resources at the 
user side. 

[0009] Further, with the method and apparatus according 
to the invention, in the selling and buying of the content 
information, the imposing of the fee to the user can be 
achieved not only when the user procures the content in- 
formation at the first time but also every time when the 
user restores and utilizes the content information. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0010] The above and other objects, features and advan- 
tages of the present invention will be apparent from the 
following description of preferred embodiments of the in- 
vention explained with reference to the accompanying draw- 
ings, in which: 

Fig. 1 is a conceptional view of the data structure 
of the content information; 



Fig. 2 is a diagram showing changes of the content 
information; 

Pig. 3 is a block diagram showing a means for gener- 
ating the content information; 

Fig. 4 is a block diagram showing a means for reduc- 
ing the partial data of the content information; 

Fig. 5 is a block diagram showing another means for 
reducing the partial data of the content information; 

Fig. 6 is a block diagram showing a means for restor- 
ing or adding the partial data of the content information; 

Fig. 7 is a block diagram showing another means for 
restoring or adding the partial data of the content infor- 
mation; 

Fig. 8 is a diagram showing the hardware construction 
according to the invention; 

Fig. 9 is a block diagram showing the processing 
means according to the invention; 

Fig. 10 is a flow-chart of the processing according 
to the invention; 

Fig. 11 is a flow-chart showing the controlling of 
the data-base; 

Fig. 12 is a diagram showing the system construction 
according to the invention; 

Fig. 13 is a diagram showing the procedures for ob- 
taining the content information from the information pro- 



ducer terminal; 

Fig. 14 is a diagram showing the procedures for ob- 
taining the content restoring information from the infor- 
mation producer terminal ; 

Fig. 15 is a block diagram showing a means for ob- 
taining the content information; 

Fig- 16 is a block diagram showing a means for ob- 
taining the content restoring information; 

Fig, 17 is a diagram showing another system construc- 
tion according to the invention; 

Fig. 18 is a diagram showing the procedures for reg- 
istering the content information to the content informa- 
tion control terminal; 

Fig. 19 is a block diagram showing a means for regis- 
tering the content information to the content information 
control terminal; 

Fig, 20 is a diagram showing the procedures for ob- 
taining the content information from the content informa- 
tion control terminal; 

Fig. 21 is a diagram showing the procedures for ob- 
taining the content restoring information from the content 
information control terminal; and 

Fig. 22 is a diagram showing the procedures for ob- 
taining the partial data of the content information from 
the content information control terminal. 



PREFERRED EMBODIMENTS OF THE INVENTION 
[0011] An exemplary data construction of the non- 
layered structure content information such as the still 
image, audio data, text data and movie image is schemati- 
cally shown in Fig. 1. The content information used in the 
present invention comprises an information code (hereinaf- 
ter referred to as a "header information") which is for 
making the content data layer-structured and the content 
data which has been layer-structured. 

[0012] In Fig. 1, the content data is shown such that 
it has been dividedly produced by three steps as the par- 
tial data aO - a2. Each of the partial data is accompanied 
by each of the header information hO - h2. In the case 
where the content information is reduced, the content data 
of the partial data a2, al are deleted. However, as the 
header information h2 r h2 of the corresponding partial 
data is not deleted, the partial data once deleted can be 
restored, if necessary, based on the header information. 
[0013] If the movie image information is taken as an 
example of the content information, it is possible to pro- 
duce the content information with the various conditions 
such as the size of the image, the quality of the image, 
the length of the reproducing time being incorporated. 
Further, according to the invention, the content informa- 
tion can effectively be utilized by the deletion or resto- 



ration of the layer-structured partial data. 
[0014] Next, with reference to Fig. 2, the principle of 
the changes in the content information which is formed by 
the internal structural information, the operation process 
information and the layer-structured content data is ex- 
plained. 

[0015] According to the invention, with the unitarily 
treating of the content information C having the layered 
structure, the internal structural information S and the 
operation process information 0, the utilization of infor- 
mation with the utilization environment and the value of 
information being taken into consideration is realized. 

[0016] Here, the content information C having the lay- 
ered structure is the content information wherein its 
quality and content, etc- are structured in a layer form. 
The internal structural information S is the information 
which represents the layer-structure of the layer- 
structured content information, the combination status of 
a plurality of non-layer structured content information or 
the combination status of the layer- and non-layer- 
structured content information. The operation process in- 
formation is a parameter which is determined with the en- 
vironments where the information is utilized are taken 
into consideration. The environment includes the lapse of 
time after the content information was produced, the load 



degree where the information is transmitted to other ter- 
minals through the network, etc., the load degree where 
the information is moved to the different media, and the 
differences between the abilities of the terminals using 
the information. 

[0017] Further, the value of the information is a pa- 
rameter which should be included in the operational infor- 
mation, namely, the operation process information 0- The 
value of the information is a parameter which is deter- 
mined with the value of the information that varies 
in accordance with the lapse of time, the value that is 
determined based on the utilization frequencies of the 
content information, or the subjective value such as the 
user's taste or preference being taken into consideration. 
[0018] According to the invention, by unitarily treat- 
ing the content information C, the internal structural 
information S and the operation process information 0, 
there is realized the information variable type informa- 
tion process method and apparatus wherein the reduction 
and restoration of the partial data repeat based on the 
internal structural information S and the operation proc- 
ess information 0. In this way, by unitarily processing 
the content information C having the layered-structure or 
in combination with the non-layer-structured content in- 
formation, the internal structural information S and the 



operation process information 0, the environments where 
the information is utilized and the changes in the infor- 
mation value become factors which cause the content infor- 
mation change. Here, such factors are called the variable 
factor VF. 

[0019] The information for the variable factor VF may 
involve the lapse of time, the genre of the content infor- 
mation, the service class of the content information pro- 
vided to the user, the designation from the user, the load 
of the system, the load of the network and the utilization 
frequency of the content information. 

[0020] Further explanation is made with reference to 
Fig. 2. Assuming that the comprehensive information in- 
cluding the content information C, the internal structural 
information S and the operation process information O is 
the information AO, such content information changes to, 
for example, the information Al with the part of the in- 
formation being reduced based on such variable factor VF 
as the lapse of time- With the further lapse of time, the 
information changes to the information A2 with the amount 
of information being further reduced based on the same 
variable factor VF. The importance here is that, although 
the information amount of the content information changes, 
the core information Cx of the information does not change 
but only the redundancy of the information is reduced. 



Therefore, if the user wishes to utilize the content in- 
formation with higher quality, the content information A2 
at the present stage is changed (restored) to the informa- 
tion Al and further to the information AO with the neces- 
sary partial data for restoration being added based on the 
corresponding variable factor VF. 

[0021] Further, it is not only the case where the 
amount of the content information is only increased or 
decreased but also the case where the resoluble content 
information can be combined with other content information 
based on such variable factor VF as the combination. In 
this way, according to the utilization environments of the 
content information and the value of the information from 
time to time, the content information can repeat the de- 
sired changes freely. 

[0022] Next, with reference to Fig. 3, the procedures 
for generating the content information is explained. 
[0023] In order to generate the content information 
which is used in the system of the invention, the content 
information C is inputted to a layer encoder 31 or a non- 
layer encoder 32, so that the content information having 
the layered-structure or the non-layered structure is pro- 
duced. Then, the content information thus produced is in- 
putted to an internal structure analyzer 33 where the 
layer-structure of the content information is analyzed and 
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the internal structural information S is generated there- 
from. The process information as to how the content infor- 
mation is processed, more specifically, the information 
concerning the lapse of time, the genre of content infor- 
mation, and the service class of the content information 
which is provided to the user is produced by an operation 
process analyzer 34 as the operation process information 
0. The above content information C, the internal struc- 
tural information S and the operation process information 
0 are integrated by an integrator 35 to produce a unified 
content information Cu so that they are unitarily treated. 
[0024] Referring to Fig. 4, the procedures for reducing 
the partial data from the unified content information Cu 
is explained. 

[0025] The unified content information Cu generated 
according to the procedures shown in Fig. 3 is separated 
by a separator 41 into the internal structural information 
S, the operation process information 0 and the content 
information C. 

[0026] Then, an internal structure checker 42 obtains 
the data structure condition of the content information C 
based on the internal structural information S. An opera- 
tion process checker 43 obtains, based on the operation 
process information 0, the information as to how to oper- 
ate the content information C, namely, as to what portion 



of the partial data is reduced* Based on the information 
thus obtained, a content information processor 44 reduces 
the partial data from the separated content information C. 
[0027] Upon completion of the deletion or reduction 
process, the internal structural information S is updated 
by an internal structure analyzer 45 so that the changes 
in the content information are reflected. Also, the opera- 
tion process information 0 is updated by an operation 
process analyzer 46. The above information is unified by 
an integrator 47 for the unification process. 
[0028] Another procedure for deleting the partial data 
of the content information, according to the invention, is 
explained with reference to Fig. 5. In this procedure, in 
addition to the processes shown in Fig. 4, an operation 
instruction information I is further added. Other proc- 
esses are the same as those in Fig. 4. Based on the opera- 
tion instruction information I which is separated by the 
separator 41, an operation instruction checker 51 obtains 
an information relating to the operation instruction. Upon 
deletion of the partial data, the operation instruction 
information I is updated by an operation instruction ana- 
lyzer 52. 

[0029] Referring to Fig. 6, the procedure for restoring 
or adding the partial data of the content information, 
according to the invention, is explained. 
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[0030] The unified content information Cu which is pro- 
duced according to the processes shown in Fig. 3 is sepa- 
rated by the separator 41 into the internal structural 
information S, the operation process information 0 and the 
content information C. 

[0031] Then, the internal structure checker 42 obtains 
the data structure condition of the content information C 
based on the internal structural information S. The opera- 
tion process checker 43 obtains, based on the operation 
process information 0, the information as to how to oper- 
ate the content information C, namely, as to what portion 
of the partial data is restored or added- Based on the 
information thus obtained, the content information proces- 
sor 44 requests the relevant partial data, which is neces- 
sary to restore the separated content information, to the 
data-base where the content information was stored as it 
was. The partial data which is necessary for the restora- 
tion or addition is obtained from the data-base and the 
content information is restored or added accordingly. 
[0032] Upon completion of the restoration or addition 
process, the internal structural information S is updated 
by the internal structure analyzer 45 so that the changes 
in the content information are reflected. Also, the opera- 
tion process information 0 is updated by the operation 
process analyzer 46, The above information is unified by 
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the integrator 47 for the unification process. 
[0033] Another procedure for restoring or adding the 
partial data of the content information, according to the 
invention, is explained with reference to Fig. 7. In this 
procedure, in addition to the processes shown in Fig. 6, 
the operation instruction information I is further added. 
Other processes are the same as those in Fig. 6. Based on 
the operation instruction information I which is separated 
by the separator 41, the operation instruction checker 51 
obtains information relating to the operation instruction. 
Upon completion of the restoring or adding process, the 
operation instruction information I is updated by the op- 
eration instruction analyzer 52. 

[0034] Fig. 8 shows an exemplary hardware construction 
of the content information producer terminal and the user 
terminal, 

[0035] In the content information producer terminal, 
the content information which is stored in an external 
memory device 82 is specified by an input device 83 
through an input/output interface 81. A central processing 
unit (CPU) 82 together with a memory 84 generates the uni- 
fied content information Cu which is constituted by the 
content information C, the internal structural information 
S and the operation process information O. The above in- 
formation can be confirmed on a display 86. 



[0036] The unified content information Cu thus gener- 
ated is transmitted to the external terminals through the 
input/output interface 81. 

[0037] In a user terminal which has basically the same 
constitution as that of the content information producer 
terminal, mainly the CPU 85 and the memory 84 monitor the 
internal structural information S and the operation proc- 
ess information 0 in the received unified content informa- 
tion Cu and store the content information in the external 
memory device 82 with, if necessary, the partial data be- 
ing deleted or restored. In the case where the restoring, 
combining or merging of the information is performed based 
on the request from the user side, such request is trans- 
mitted to the outside terminals through the input /output 
interface 81. 

[0038] The hardware construction is not limitative to 
the one illustrated in Fig. 8. The necessary hardware can 
be constituted by using, for example, electric signal 
switching devices without using the CPU 85. 
[0039] Next, the procedure according to the invention 
is explained with reference to Fig. 9. The unified content 
information used in the system of the invention is gener- 
ated by a content information generator 91, while the op- 
eration information with respect to the content informa- 
tion is generated by an operation information generator 



92. 

[0040] To an information variation processor 93, the 
variable factor information generated in a variable factor 
generator 94 is inputted. The information variation proc- 
essor 93 causes a content information processor 93a and an 
operation information updater 93b to operate. The content 
information processor 93a operates to delete the content 
information or to add the partial data by using an adding 
information generator 95. The operation information is 
updated by the operation information updater 93b in accor- 
dance with the changes in the content information. 
[0041] The information outputted from both the proces- 
sors is subjected to the deletion of its partial data by 
the information deletion section 96 if the content of the 
operation information includes the deletion information 
for the information. In the case where the user issues a 
request for deletion of the partial data of the informa- 
tion, in the same manner, the deletion process is per- 
formed by the information deleting section 96. In other 
cases than the above, the information is again inputted to 
the information variation processor 93 and the same proc- 
esses are repeated. 

[0042] Next, with reference to the flow-chart of Fig. 
10, the procedures according to the invention are ex- 
plained. 
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[0043] In Step 101, the content information C of the 
layer-structured or non-layer-structured content which is 
used in the system of the invention is generated. At the 
sane time, in Step 102, an internal structure of the con- 
tent information C which is generated in Step 101 is ana- 
lyzed and the internal structural information S is gener- 
ated. In Step 103, based on the internal structural infor- 
mation S, the operation process information 0 with respect 
to the content information C is generated. In Step 104 r 
information of the variable factor VF which causes the 
content information C to vary is generated. The variable 
factor VF gives an opportunity of the updating process of 
the internal structural information S which takes place in 
Step 105. Specifically, in Step 105, the internal struc- 
tural information S is updated based on the operation 
process information 0 and the analysis of the variable 
factor VF generated in Step 104. In Step 106, the opera- 
tion process information 0 is updated in accordance with 
the internal structural information S which has been up- 
dated in Step 105. Based upon the operation process infor- 
mation 0 which has been updated, the way how to process 
the content information C is determined. In Step 107, the 
analysis result in Step 106 is determined. If the result 
indicates the addition of the partial data, the process 
goes to the restoring and adding process in Step 108. If 
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the result indicates the deletion of the information, the 
process goes to the partial data deleting process in Step 
109. If there is no change in the result, the process goes 
to the content information deletion check process in Step 
110. 

[0044] If the determination result in Step 107 indi- 
cates the restoring and addition of the partial data, in 
Step 108, the restoration information or the adding infor- 
mation are obtained and the content information is re- 
stored or other content information is added. If the de- 
termination result in Step 107 indicates the deletion of 
the content information, the content information is re- 
duced by the deletion of the partial data in Step 109. 
[0045] In Steps 110 and 111, if the analysis result in 
Step 106 indicates the deletion of the content informa- 
tion, there takes place the deletion process of the con- 
tent information. If the instructions of the deletion of 
the content information is given by the request from the 
user, such information is deleted in the same way. 
[004 6] If the given instructions are not for the dele- 
tion of the information, such information is again sub- 
jected to the analysis of the operation information and 
the updating process. After the determination of the re- 
sult, the above procedures are repeated. 
[0047] Next, with reference to the flow-chart of Fig. 
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11, the way how to control the increase and decrease of 
the data amount of the content information in the data- 
base is explained. In Step 115, the total data amount of 
the content information is determined whether it exceeds 
the specified amount n or not. If yes, the information is 
reduced by making the information deleting section oper- 
ated in Step 116. In other cases, monitoring of the con- 
tent information is continued through Step 117. Upon re- 
ceipt of the end instructions of monitoring, the control 
of the content information is ended. 

[0048] The system of the present invention is explained 
in more detail with reference to Fig. 12. In this illus- 
trated embodiment, a content information producer terminal 
X and a plurality of user terminals A, B are connected in 
the network. In the content information producer terminal 
X, the content information C r the internal structural in- 
formation S and the operation process information 0 are 
produced and, after they are integrated or combined, they 
are stored as the unified content information. 

[0049] Fig. 13 shows the procedures for obtaining the 
content information in the system shown in Fig. 12. If the 
acquisition request for the content information is issued 
from the user terminal A to the content information pro- 
ducer terminal X, at the content information producer ter- 
minal X, the user registration or updating process for 
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allowing the user A to utilize the stored conrent informa- 
tion is effected. The content information producer termi- 
nal x transmits the presentation of the fee for the con- 
tent information to the user terminal A. Upon receipt of 
the fee presentation, at the user terminal A, the user A 
pays the presented fee electronically. Upon receipt of the 
fee payment information for the content information from 
the user terminal A, the content information producer ter- 
minal X transmits the acknowledging information to the 
user terminal A after the completion of the fee imposing 
process. Simultaneously, the content information producer 
terminal X transmits the relevant content information re- 
quested by the user A to the user terminal A. 
[00503 Hereunder, the content information acquisition 
process is explained in detail by referring to Fig. 15. 
[0051] Where the content information acquisition re- 
quest is transmitted from the user terminal A to the con- 
tent information producer terminal X, the request informa- 
tion such as the user's identification number and the re- 
quested content is analyzed by a request analyzer 151. If 
the user's request is determined as satisfying the re- 
quirements by a request checker 152, the user is regis- 
tered by a user registration processor 153 and the regis- 
tration confirmation information is sent back to the user 
terminal A. If the acquisition of information is allowed 
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by the request checker 152, the user registration proces- 
sor 153 is operated. In other cases, the message for re- 
questing the resending of the acquisition request is is- 
sued to the user A and the procedure returns to the ini- 
tial state accordingly. 

[0052] In the content information producer terminal X 
which has received from the user terminal A electronically 
the fee payment information for utilizing the content in- 
formation, such fee payment information is analyzed by a 
payment information analyzer 154 and it is determined by a 
payment information checker 155 as to whether the correct 
fee has been paid or not. If it is determined that the 
correct fee has been paid, the fee imposing process for 
the content information with respect to the registered 
user is performed by a charge processor 156 and the rele- 
vant content information is transmitted to the user termi- 
nal A. If the fee payment information is determined as 
incorrect, the re-sending request is issued to the user 
terminal A and the procedure returns to the initial state. 
The above fee imposing process may well be performed after 
the transmission of the content information or performed 
after the updating of the information in the same way, 
[0053] At the user terminal A, the received content 
information is stored in the external memory device and 
the user A is allowed to use the content information. In 
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the user terminal A, monitoring of the variable factor 
with respect to the content information is conducted, and 
updating of the content information as well as updating of 
the internal structural information and the operation 
process information in accordance with the operation in- 
struction information are conducted. In the case where the 
user wishes to utilize the content information whose par- 
tial data has been once deleted, after the restoration of 
the partial data, the user terminal A transmits to the 
content information producer terminal X the information 
restoring request. 

[0054] As shown in Fig. 14, the content information 
producer terminal X which received the information 
restoring request for the reduced content information 
transmits to the user terminal A the presentation of 
restoration fee in response to the user's information 
restoring request. The user A which received the 
presentation of the content information restoration fee 
electronically pays the relevant fee. 

[0055] Upon receipt of the information of the restora- 
tion fee payment for the content information, the content 
information producer X transmits the acknowledging infor- 
mation to the user terminal A and, then, transmits to the 
user A the partial data which is necessary for the resto- 
ration process after the preparation of the same from the 



stored content information. 

[0056] The user terminal A which received the content 
information for restoring process analyzes the operation 
instruction information and performs the restoring process 
of the content information in accordance with the restor- 
ing request. Further, the internal structural information 
S and the operation process information 0 are updated. The 
user A is allowed to utilize the content information cor- 
responding to the user's restoring request. 
[0057] Thereafter, the user A can utilize the content 
information under the state wherein monitoring of the 
variable factor with respect to the operation information 
is continuously performed and the fee imposing process is 
effected repeatedly, if necessary, between the content 
information producer terminal X and the user A. It is 
needless to say that the content information can be used 
by the user terminal B in the same way as the user termi- 
nal A. 

[0058] Now, the procedures for obtaining the content 
information for restoration process will be explained with 
reference to Fig. 16. 

[0059] Where the content information restoring request 
is transmitted from the user terminal A to the content 
information producer terminal X, the request information 
such as the user's identification number, the requested 
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content information and the relevant partial data of the 
content information is analyzed by a restoring request 
analyzer 161. If the user's request is determined as sat- 
isfying the requirements by a restoring request checker 
162, the user is registered by a user registration proces- 
sor 163 and the registration confirmation information is 
sent back to the user terminal A. If the user's request is 
determined as incorrect, the message for requesting the 
resending of the restoring request is issued to the user A 
and the procedure returns to the initial state accord- 
ingly. 

[0060] At the content information producer terminal X 
which has received from the user terminal A the fee pay- 
ment information relating to the restoration of the con- 
tent informati on, the fee imposing procedure which is the 
same as in Fig. 15 is effected as shown in Fig. 16. 
[0061] Next, another embodiment will be explained with 
reference to Fig. 17, 

In the embodiment shown in Fig. 17 , in addition to 
the content information producer terminal X and the user 
terminals A, 3, a content information control terminal Y 
which controls or manages the content information is con- 
nected to the same network. In this embodiment, the con- 
tent information producer terminal X registers in advance 
the content information in the content information control 
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terminal Y, and the user makes an information acquisition 
request or an information restoring request to the content 
information control terminal Y, if necessary. The content 
information control center Y performs centrally the deliv- 
ering of the content information and the fee imposing pro- 
cedure, and it has a function to feedback to the producer 
X the fee paid by the users A, B. 

[0062] A detailed explanation is made with reference to 
Fig. 18. The content information producer terminal X is- 
sues to the content information control terminal Y a reg- 
istration request for registering the relevant content 
information produced by the producer X. The content infor- 
mation control center Y performs the registration or up- 
dating procedure of the producer of the relevant content 
information and, then, it transmits to the content infor- 
mation producer terminal X the confirmation information 
relating to the producer registration procedure. 
[0063] Upon receipt of such registration confirmation 
information, the content information producer terminal X 
transmits the selected content information to the content 
information control terminal Y. At the content information 
control terminal Y, such content information is accumu- 
lated or stored in the external memory device. The control 
center Y then transmits to the content information pro- 
ducer terminal X the confirmation message informing that 
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the content information has been stored correctly. 

[0064] Here, the registering procedures of the content 
information producer and the content information are ex- 
plained in detail with reference to Fig. 19. 

[0065] Where the content information registration re- 
quest issued from the content information producer termi- 
nal X is received by the content information control cen- 
ter Y, the request information such as the identification 
number of the registrant is analyzed by a registration 
request analyzer 191. If the registrant request is deter- 
mined as satisfying the requirements by a registration 
request checker 192, the producer is registered by a pro- 
ducer registration processor 193 and the registration con- 
firmation information is sent back to the producer termi- 
nal X. If the request is determined as incorrect by the 
registration request checker 192, the message for request- 
ing the resending of the registration request is issued to 
the producer terminal X. 

[0066] At the content information control center Y 
which has received the relevant content information from 
the content information producer terminal X, such content 
information is analyzed by a content registration analyzer 

194 and it is determined by a content registration checker 

195 as to whether the content information can be regis- 
tered or stored correctly or not. If it is determined as 



yes, the relevant content information is registered in the 
data-base by a content registration processor 196. Then, 
the registration confirmation information is transmitted 
to the information producer terminal X. If the registra- 
tion process is determined as incorrect, the message for 
requesting the resending of the content information regis- 
tration request is issued to the content information pro- 
ducer terminal X. 

[0067] Referring to Fig. 20, the flow of data between 
the content information control terminal Y and the user 
terminal A which takes place when the content information 
acquisition request is made is explained. When the request 
for acquisition of the content information is transmitted 
from the user terminal A to the content information con- 
trol terminal Y, at the content information control termi- 
nal Y, the user registration or updating process is car- 
ried out for the user A to utilize the accumulated content 
information. Then, from the content information control 
terminal Y, presentation of the content information acqui- 
sition fee is transmitted to the user terminal A. On re- 
ceiving the transmission, the user terminal A carries out 
electronic payment of the acquisition fee indicated. At 
the content information control terminal Y, the payment 
information of the acquisition fee is received from the 
user terminal A, the fee imposing process is conducted 
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and, thereafter, the acknowledging information is trans- 
mitted to the user terminal A. From the content control 
terminal Y, the content information requested by the user 
A is transmitted to the user terminal A. 

[0068] At the user terminal A, the content information 
received is stored in the external memory device. In this 
way, the user A can utilize such content information. At 
the user terminal A, the variable factor with respect to 
the content information recorded is monitored and, accord- 
ing to the operation information, the content information 
is updated and the operation information is also updated. 
Under the state where the content information has been 
reduced or deleted in the user's terminal, when the user 
desires to restore and use the updated content informa- 
tion, the restoration request for the updated content in- 
formation is transmitted from the user terminal A to the 
content information control terminal Y. 

[0069] Referring to Fig. 21, the flow of data between 
the content information control terminal Y and the user 
terminal A when the content information restoring request 
is made is explained. Upon receiving the request for res- 
toration of the content information, the content informa- 
tion control terminal Y transmits to the user terminal A 
the presentation of content information restoration fee. 
Then, the user A which has received the presentation of 
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fee pays electronically the necessary restoration fee as 
shown. At the content information control terminal Y, upon 
receiving the restoration fee payment information, the fee 
imposing process is conducted and the acknowledging infor- 
mation is transmitted to the user terminal A. Then, after 
the drawing out a partial data necessary for restoring 
process from the recorded content information and the 
preparation of the content information for purposes of 
restoration, such content information requested by the 
user A is transmitted to the user terminal A from the con- 
tent information control terminal Y. 

[0070] At the user's terminal A which has received the 
content information for restoration purposes, the opera- 
tion information of the content information is analyzed, 
and the content information for which the restoration re- 
quest has been made is subjected to the restoration proc- 
ess. Also, the internal structural information S and the 
operation process information 0 are updated, and the user 
A can utilize the restored content information in accor- 
dance with the restoring request. 

[0071] At the content information control terminal Y, 
the content information acquisition or restoration fees 
are summed up, and these fees are fed-back to the content 
information producer X. 

[0072] Thereafter, the user A can utilize the content 



information under the state wherein monitoring of the 
variable factor with respect to the operation information 
is continuously performed and the fee imposing process is 
effected repeatedly, if necessary, between the content 
information control terminal Y and the user A. 
[0073] Now, a further different embodiment of the in- 
vention is explained hereunder. This embodiment relates a 
system which is equipped with the control terminal Y and 
in which to the user terminal A a partial data of the con- 
tent information has been transmitted in advance and, if 
the user A requests not only the partial data but also the 
data which exceeds the partial data, the restoration of 
the information and the fee imposing processes are sequen- 
tially performed. The configuration of the system is the 
same as one shown in Fig. 17. 

[0074] The details of the system are explained with 
reference to Fig. 18. The content information producer X 
transmits a request that the content information prepared 
in advance be registered at the content information con- 
trol terminal Y. At the content information control termi- 
nal Y, the registration of the content information or the 
updating process is conducted. Then, the acknowledging 
information on the content information registration proc- 
ess is transmitted to the content information producer 
terminal X. 
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[0075] The content information producer X who has re- 
ceived the acknowledging information on the content infor- 
mation producer registration process selects the content 
information to be registered and transmits it to the con- 
tent information control terminal Y. Then, at the content 
information control terminal Y which has received the 
above content information, the information is stored in 
the external memory device and the acknowledging informa- 
tion of the content information registration is transmit- 
ted to the content information producer terminal X. 
[0076] Next, as shown in Fig. 22, when the acquisition 
request for the partial data of the content information is 
transmitted from the user terminal A to the content infor- 
mation control terminal Y, the user registration or updat- 
ing process for the user A to utilize the accumulated con- 
tent information is conducted at the content information 
control terminal Y. 

[0077] Then, the partial data of the content informa- 
tion requested by the user A is transmitted to the user 
terminal A from the content information control terminal 
Y« Since the content information transmitted at this stage 
consists of the partial data as well as the internal 
structural information and the operation information to be 
utilized unitarily with the above partial data, the use of 
a part of the content information based on the partial 
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data does not require the utilization fee. 
[007 8] The user terminal A causes the received content 
information to be stored in the external memory device, 
and this allows the user A to utilize the content informa- 
tion. When the user desires to use the entire information 
corresponding to the partial data or to use more content 
information by restoration, the restoring request is 
transmitted to the content information control terminal Y 
from the user terminal A. 

[0079] As shown in Fig. 21, upon receiving the restor- 
ing request for the content information, the content in- 
formation control terminal Y transmits to the user termi- 
nal A the presentation of content information utilization 
fees proportional to the amount of the restoration infor- 
mation. The user A having received the presentation of the 
content information utilization fees electronically pays 
the fees thus presented, 

[0030] Upon receiving the restoration fee payment in- 
formation for the content information, the content infor- 
mation control terminal Y transmits the acknowledging in- 
formation to the user terminal A, and draws out the par- 
tial data necessary to restore the information from the 
stored content information, prepares the content informa- 
tion for restoration purposes and transmits it to the user 
terminal A. 



[0081] The user terminal A having received the content 
information for restoration purposes analyzes the opera- 
tion information of such information and performs the res- 
toration process of the content information for which the 
restoring request was made. Further, the internal struc- 
tural information and the operation information are also 
updated. In this way, the user A can utilize the content 
information in accordance with the request of the user A. 
[0082] At the content information control terminal Y, 
the content information utilization fees are added up, and 
such fees are fed-back to the content information producer 
X. 

[0083] Thereafter, the user A can utilize the content 
information under the state wherein monitoring of the 
variable factor with respect to the operation information 
is continuously performed and the fee imposing process is 
effected repeatedly, if necessary, between the content 
information control terminal Y and the user A. 
[0084] As explained hereinabove, the system according 
to the invention comprises means for generating the 
content information such as the images or audio data which 
has a layer structure and which is unitarily processed 
with the internal structural information and the operation 
process information, and means for utilizing only the nec- 
essary portion of the content information by deleting or 
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restoring the partial data of the content information gen- 
erated by the means for generating the content informa- 
tion. The content information whose value becomes low can 
be automatically reduced or deleted, and such content in- 
formation whose partial data has been once deleted can be 
restored, if desired, by newly obtaining the partial data 
which corresponds to the deleted partial data from the 
network- As a consequence, it has become possible to ef- 
fectively utilize the hardware resources at the user side. 
[0085] While the invention has been described in its 
preferred embodiments, it is to be understood that the 
words which have been used are words of description rather 
than limitation and that changes within the purview of the 
appended claims may be made without departing from the 
true scope of the invention as defined by the claims. 
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